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We  consider  a class  of  "generalized  equations,"  involving  point-to-set 
mappings,  which  formulate  the  problems  of  linear  and  nonlinear  programming 
and  of  complementarity,  eimong  others.  Solution  sets  of  such  generalized  equa- 
tions are  shown  to  be  stcible  under  certain  hypotheses;  in  particular  a general 
form  of  the  implicit  function  theorem  is  proved  for  such  problems.  An  appli- 
cation to  linear  generalized  equations  is  given  at  the  end  of  the  paper;  this 
covers  linear  and  convex  quadratic  programming  and  the  positive  semidefinite 
linear  complementarity  problem.  The  general  nonlinear  progreunming  problem  is 
treated  in  Part  II  of  the  paper,  using  the  methods  developed  here. 
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SIGNIFICANCE  AND  EXPLANATION 

Linear,  quadratic  and  nonlinear  optimization  problems  occur  in  manage- 
ment science,  in  engineering  and  in  other  areas.  One  of  the  important  questions 
that  arise  about  such  problems  is  that  of  stadaility:  if  we  solve  such  a problem 
with  slightly  perturbed  data,  will  the  solution  that  we  find  be  close  to  a 
solution  of  the  original  problem?  Note  that  we  say  "a"  solution,  not  "the" 
j solution, since  there  may  be  more  than  one. 

In  this  two-part  paper  we  show  that  this  property  of  stability  holds, 
under  specified  conditions,  for  classes  of  optimization  problems  commonly  found 
I • in  applications.  The  results  are  also  applicable  to  more  general  situations, 

J such  as  complementarity  problems  and  economic  equilibria. 


The  resjjonsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 
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nFNKRAl.IZED  EQUATIONS  AND  THEIR  SOLUTIONS, 
PART  I:  BASIC  THEORY 

Stephen  M.  Robinson 


1.  Introduction . In  this  paper  we  shall  study  the  behavior  of  solutions  of  the 
generalized  equation 


0 € f(x)  + T(x)  , (1.1) 

where  f is  a continuously  Frechet  differentiable  function  from  an  open  set  c TP^‘ 
into  3R*^  and  T is  a maximal  monotone  operator  from  into  itself  (recall  that  an 

operator  T is  monotone  if  for  each  (x^,w^),  oraph  T one  has 

<Xj  - Wj  - W^)  > 0 , 


where  < •,  •>  denotes  the  inner  product,  and  maxinal  monotone  if  its  tiraph  is  not 
properly  contained  in  that  of  any  other  monotone  operator).  We  use  the  term  "generalized 
equation"  because  if  T is  identically  zero  then  (1.1)  reduces  to  tlie  equation  f(x)  ■ 0, 
and  because  systems  li)ie  (1.1)  retain  some  of  the  analytic  properties  of  nonlinear  equa- 
tions, as  we  shall  show  in  what  follows. 

We  shall  be  particularly  interested  in  conditions  which,  when  imposed  on  f and  T, 
will  ensure  that  the  set  of  solutions  to  (1.1)  remains  nonempty  and  is  well  behaved  (in  a 
sense  to  be  defined)  when  f is  subjected  to  small  perturbations.  To  introduce  t*'ese  per- 
turbations, we  shall  ma)(e  use  of  a topological  space  P and  a function  f : P « , 

so  that  we  can  replace  (1.1)  by 

0 e f(p,x)  + T(x)  , (1.2) 

and  study  the  set  of  x which  solve  (1.2)  as  p varies  near  a base  value  p^. 


A particular  case  of  (1.2)  of  special  interest  for  applications  is  that  in  which  T 
is  talten  to  be  the  operator  where  for  a closed  convex  set  C c one  defines  the 

indicator  function  of  C by 
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Science  Foundation  under  Grant  No.  (1CS74-20SB4  A02, 


*c(x)  : 


X f C 


X ^ C , 

and  where  3 denotes  the  subdifferential  operator  (13,  5231.  This  yields  the  special 
generalized  equation 

0 £ f(p,x)  + 3i)/p(x)  , (1.3) 

which  expresses  analytically  the  geometric  idea  that  f(p,x)  is  an  inward  normal  to  C 
at  X. 

Many  problems  from  mathematical  prograimning,  complementarity,  mathematical  economics 
and  other  fields  can  be  represented  in  the  form  (1.3):  for  example,  the  nonlinear  comple- 
mentarity problem 

F(x)  £ K* 

X e K (1.4) 

(x,F(x))  - 0 

where  F : k"  ♦ »"  , K is  a nonempty  polyhedral  convex  cone  in  , and 

K : • (y  £ »''  l(y,)£>  > 0 for  each  k £ K),  can  be  written  as 

0 f F(x)  ♦ 3*|^(x)  . 

Further  information  on  nonlinear  complementarity  problems  (often  with  K ■ »”  , the  non- 
negative orthant)  may  be  found  in,  e.g.,  |2I,  (4),  (7),  (Bl  . The  Kuhn-Tuc)£er  necessary 
conditions  for  mathematical  prograimning  (6)  form  a special  case  of  (1.4);  e.g.,  for  the 
problem 

minimize  e(y) 

subject  to  g(y)  < 0 (1.5) 

h(y)  - 0 

where  6,  g and  h are  differentiable  functions  from  n"  into  * , and 

respectively,  one  has  the  Kuhn-Tuciier  conditions 
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o' (y)  ♦ ug' (y)  + vh'(y)  « 0 

g(y)  < 0 


h(y)  - 0 


< u,g(y))  • 0 , 

and  these  can  be  written  in  the  form  (1.4)  by  ta)cinq  n-m  + q + r,  K*®"' 


X • (y,u,v)  and 


to’ (y)  * ug' (y)  + vh' (y) ] 


There  are  also  important  applications  of  (1.3)  to  economic  equilibrium  problems  115),  among 
others.  It  is  of  interest  to  note  that  in  most  of  the  apolications  mentioned  one  finds 
that  C is  a polyhedral  convex  set,  and  we  shall  see  that  particularly  strong  results  can 
be  obtained  for  such  problems. 

It  is  also  worth  pointing  out  that  problems  of  linear  or  quadratic  programiing  lead 

m K. 

to  linear  generalized  equations:  for  ex^unple,  if  P c B and  Q c TR  are  two  polyhedral 

convex  cones,  H and  A are  matrices  of  dimensions  m x m and  a x m respectively, 
m i 

c £ F and  a r F , then  we  can  consider  the  quadratic  proqreutming  problem 

minimize  ^<X,Hx>  + ( c,x) 

(1.6) 

* 

subject  toa-AxeQ,X£P  , 

* 

where  Q is  the  dual  cone  of  Q.  The  necessary  optimality  condition;;- for  (1.6)  are 
(assuming  without  loss  of  generality  that  H is  symmetric) : 


xH  + c + uAc  P 


a-Ax  £ Q 


<x  H + c u A,  x>  « 0 , <u,  a-Ax>  • 0 . 

These  can  be  formulated  in  a somewhat  more  transparent  manner  by  writing  them  as 
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a linear  generalized  equation  which,  if  P and  Q are  taken  to  be  IR™  and 
respectively  (i.e.,  in  the  case  of  quadratic  programming  with  equality  constraints  and 
unconstrained  variables)  reduces  to  an  ordinary  linear  equation.  We  shall  see  that  linear 
generalized  equations  are  basic  to  the  analysis  done  here  in  much  the  same  way  as  linear 
equations  are  basic  to  the  analysis  of  nonlinear  equations. 

The  organization  of  this  paper  is  as  follows:  in  the  next  section  we  state  and  prove 
the  main  result  (Theorem  1)  after  defining  a property  used  in  the  statement.  We  also  dis- 
cuss a way  of  simplifying  (by  restricting)  one  of  the  hypotheses.  In  Section  3 we  examine 
a class  of  multivalued  functions  frequently  found  in  applications,  and  show  that  they  have 
one  of  the  key  properties  needed  in  Theorem  1.  Finally,  in  Section  4 we  apply  the  results 
of  Sections  2 and  3 to  linear  generalized  equations.  Applications  to  nonlinear  problems 
will  be  the  subject  of  Part  II  of  this  paper. 

2.  Main  results.  Before  stating  the  main  theorem,  we  require  a preliminary  defini- 
tion dealing  with  a certain  continuity  property  of  multivalued  functions  (or  multifunctions, 
as  we  shall  call  them). 

DEFINITION  1:  Let  X and  Y be  normed  linear  spaces.  A multifunction  F : X < Y 
is  upper  Lipschitzian  with  modulus  X,  or  U.L.(X),  at  a point  x^^  « X with  respect  to 
a set  V c X,  if  for  each  v e V one  has 

F(v)  c F(Xq)  + Xll  V - XgllBy  , 

where  B^  is  the  unit  ball  in  Y.  We  say  F is  locally  U.L.(X)  at  x^  if  it  is 
U.L.(x)  at  Xjj  with  respect  to  some  neighborhood  of  x^. 

TYiis  property  is  close  to  the  Lipschitz  continuity  for  multifunctions  defined  by 
Rockafellar  |14,  53),  except  that  we  do  not  require  f(xQ)  to  be  a singleton;  in  the  pro- 
blems we  shall  consider  fix^)  will  often  l>e  multivalued.  Note  that  the  distance  from  any 
point  of  r(v)  to  the  set  f‘(Xg)  is  bounded  above  by  X !l  v - Xg  II  • although  the  distance 
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from  a point  of  F(v)  may  be  large. 

Before  stating  the  main  theorem,  we  shall  try  to  motivate  its  hypotheses.  Recall 
that  in  the  classical  inverse-function  theorem  the  key  assumption  is  that  the  lineariza- 
tion of  the  function  being  considered,  about  a point  in  the  inverse  image  of  0, 

should  be  regular:  specifically,  that  the  inverse  image  of  0 under  the  linearized 
function  should  be  a singleton  (in  fact,  the  point  x^  itself).  In  our  situation,  since 
we  may  be  dealing  with  solution  sets  rather  than  points,  we  have  to  linearize  about  each 
point  in  a set.  The  first  assumption  in  the  theorem  is  that  there  is  a nonempty  bounded 
set  Xg  (analogous  to  the  point  x^  in  the  classical  case)  such  that  the  inverse  image 
of  0,  under  an  appropriate  kind  of  linearization  performed  at  any  point  of  X^^,  is 
Xq  itself  together  with,  possibly,  points  outside  some  neighborhood  of  X^.  There  is 
also  an  assumption  of  uniform  upper  Lipschitz  continuity,  which  is  automatically  true  in 
the  classical  case.  Finally,  there  is  an  assumption  that  the  inverse  image  of  any  point 
near  0,  under  the  linearization  previously  mentioned,  has  a convex  comfxinent  in  the 
neighborhood  of  X^  within  whicli  we  are  working.  In  tl-e  classical  case  this  is  equiv- 
alent to  the  first  hypothesis,  but  not  so  here. 

We  shall  show,  below  and  in  Part  II,  that  many  problems  of  practical  interest 
satisfy  these  hypotheses.  In  particular  we  show  in  Proposition  1 that  the  third  assump- 
tion can  be  replaced  by  an  assumption  of  positive  semidefiniteness  which  is  often  satis- 
fied in  applications. 

In  the  following  theorem,  we  use  f^  to  denote  the  partial  Frechet  derivative,  with 
respect  to  the  second  argument,  of  a function  f(p,x)  of  two  variables;  B denotes  the 
unit  ball  in  n''  with  respect  to  the  Euclidean  norm,  which  Is  used  throughout  the  re- 
mainder of  the  paper. 

THEOREM  1 ! Let  P be  a topological  space.  Si  an  open  set  in  and  T a 

maximal  monotone  operator  from  f”  into  itself.  Let  f be  a continuous  function  from 


p X n into  K 


such  that  f,  is  continuous  on  P x fj.  Let  p t Pj  write  Lf  (x) 


for  ^2  *’'”*0*  ■ Suppose  that  there  are  a nonempty,  bounded  convex  set 

X.  ^Uld  constants  X.  Y > 0 and  n > 0 with  X : « X.  + yB  c fj,  such  that  for  each 
0 Y 0 


"o  = 

i) 

X n (Lf  + T)”^ 

(0)  » 

"o' 

11) 

X n (Lf  + T)*^ 

^ ’‘o 

is 

U.L.(X)  at  0 

iii) 

For  each  y £ nB, 

X n 

(Lf  + T)‘^y) 

Then  there  exist  a number  6 c (O.y)  and  a neighborhood  U(Pg)  such  that  with 


Kp)  ! 


{x  £ Xq  + 6b|o  c f(p,x)  + T(x)},  p £ U 


^ U 


one  has : 


and 


1)  j:  is  upper  semicontinuous  from  U ^ IR  , 

2)  !;(Pj,)  - Xq, 


3)  For  each  c > 0,  for  some  neighborhood  and  for  each  p f , 

« * Kp)  c KPq)  + (X  + e)ajj(p)B  , 

where 

ag(p)  : - max{|l  f(p,x)  - f(Pp,x)l|  | x £ X^)  . 

Note  that  if  P is  actually  a normed  linear  space  and  if  f(p,x)  is  Lipschitzian 
in  p uniformly  over  x £ X^,  then  for  some  constant  u and  each  p £ we  have 


Kp)  c I(pg)  + (X  + E)ij||  p - PqII  B 


so  that  f is  locally  U.L.  ((X  + c)ij1  at  p 
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► 


Let  P • (0,n)  with 

B c . Hypothesis  (iii), 
PB,  n O(x^)  ^(y)  is  non- 
convex  set . 

■Rie  basic  idea  of  the  proof  is  to  approximate  the  inverse  of  the  operator 
f(p,x)  + T(x)  by  the  inverse  of  the  operator 

Q(i(x))(z)  : = + T(z) 

* ffPQ.xix))  + f^iPpiUCx)) (z-Xp)  + T(z)  , 

where  »i(x)  is  the  closest  point  to  x in  X^,  just  as  one  approximates  the  inverse 
of  a function  in  the  classical  inverse- function  theorem  by  the  inverse  of  its  lineariza- 
tion about  some  point.  We  then  apply  a fixed-point  theorem:  in  proving  the  inverse- 
function  theorem  one  usually  uses  the  contraction  principle,  but  here  we  have  to  use 
the  Kakutani  theorem.  Observe  that  the  "linearized"  operator  appearing  here  is  of 
the  type  we  discussed  above  in  considering  linear  generalized  equations;  this  illus- 
trates our  comment  that  these  operators  play  a role  in  the  analysis  of  generalized  equa- 
tions analogous  to  that  of  linear  operators  in  classical  analysis. 

Of  course,  during  this  approximation  it  will  be  necessary  to  be  careful  that  we 
work  with  the  correct  component  of  the  inverse  image  (i  .e. , that  lying  in 
this  adds  a certain  amount  of  complexity  to  the  notation. 


PROOF:  Choose  x • X,,:  denote  Lf  + T by  O(x-)  . 

0 0 Xq  0 

>0  < > and  let  y « 6B:  then  X.^  n Qfx^^)  ^(v)  c X^^  + >||y|| 
together  with  closure  of  ®<Xg) , implies  that  for  each  y e 


empty,  compact  and  convex.  In  particular,  X^^  is  a compact 
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Define,  for 

two  subsets 

A 

and 

C of 

and  a point 

X € f"  , 

dIx,Cl  : • inf{  11  X 

- cll  Ic  t C} 

and 

dlA,Cl 

= sup(dIa,Cl  la  e A) 

, whe  re 

the 

supremum 

and  inflmum  of  0 

are  defined 

to 

be 

and 

+« 

respective ly . 

Denote 

by 

the  pro- 

section  from  f" 

onto  Xq'"" 

is 

well 

)cnown 

to  be 

nonexoansive , 

hence  a 

fortiori  con- 

tinuous. 


Using  continuity  and  compactness,  one  can  show  that  the  function 
B(6)  ! • max  { 11  f^Cp^.x)  - (Pg,n  (x) ) H lx  e + 6B} 

is  well  defined  for  small  6,  and  is  continuous  at  0 with  6(0)  • 0.  Thus,  we  can 
choose  a 6 « (0,y]  such  that  XB(6)  < j and  66(6)  < j 0.  It  is  not  difficult  to  show 
that  for  this  fixed  6 the  function 

aj(p)  : « max{  11  f(p,x)  - f(P|^,x)ll  lx  e X^} 


is  well  defined  for  all  p t P,  and  is  continuous  at  p^  with  aj(Pp)  = 0.  Thus,  we 

can  choose  a neighborhood  U(p„)  such  that  for  each  p c U,  a (p)  < and 

0 t * 

)aj(p)  < j6  . Now  choose  any  p c U,  and  define  a multifunction  from  X^  into 

by 


F (x)  : - X n p(ii(x))  ^(Lf  , , (x)  - f(p,x)l 
p Y ¥(x) 


If  X is  any  point  of  X , we  have 

6 

ll^^¥(x)‘’‘’  ■ < llftp.x)  - f(Po.x)ll  + llf(PQ,x)  - Lf^j^j(x) 


(2.1) 


Now  define  (for  this  fixed  x)  a function  of  one  real  variedsle  i by 

g(T)  : ” f(p„,TX  + (1  - t)¥(x))  - Lf  (tx  + (1  - t)¥(x)) 

0 W I XJ 

We  find  that 


lg(l)  - g(0)ll  < sup{  llg'(T)lllo  s t < 1} 


However,  for  t € (0,1), 


g’  (T)  = 


f2(PQ.’’(x)  ) 1 (x  - H (x)  1 


where  x :=•  Tx  + (1  - T)ii(x).  We  have  by  properties  of  the  projection  that 
T 

T (X^)  ” It  (x)  , SO 

Ikj'Po'N’  ■ ^2*^0''"'*’*  II  'II^2‘^0’*t’  ■ f2‘Po'’'‘’‘T”  II  = ' 


Since  X € X,.  Hence 
T 5 


II  f (Pq,x)  - Lf^  (x)  II  < B (6)  I!  X - t (x) 


(2.2) 


As  |lf(p,x)  - f(p  ,x)||  < a,  (p),  we  have  from  (2.1)  and  (2.2) 


I Lf^  (x)  ' f (P»x)  II  < Oj  (p)  + B (S)  II  X - - (x)  i 


(2.3) 


< le  + ie  = 0 . 

2 2 

Hence,  by  our  previous  remar)cs  Pp*’*)  ^ nonempty  compact  convex  set  for  each  x . X 

Also,  using  (i) , (ii)  and  (2.3)  we  have  for  x e X^, 

dlF  (x),X„)  = dlx  n Q(ii(x))'^(Lf  , , (x)  - f(p,x)!,X  n Q(it  (x)  ) "'•  (0)  I 
p 0 Y t(x)  Y 

< X II  Lf^  (x)  - f (p,x)  II 

< Xa^(p)  + X6(S)||  X - Ti(x)l|  1 ^ ' 


(2.4) 


so  F carries  X,  into  itself.  We  have 
P * 

graph  F^  = {(x,y)|x  f X^,  y f X^,  Lf^j^j(x)  - f(p,x)  t + T(y) } 

- {(x,y)|0  f f(p,x)  + f2(PQ.i'(x) ) (y-x)  + T(y))  n (X^  x x^)  . 

Using  the  continuity  of  f,  f^,  and  r,  together  with  the  fact  that  T is  closed  (by 

maximal  monotonicity)  , one  can  show  without  difficulty  that  graph  F^  is  close',  in 

X,  X X,.  We  can  thus  apply  the  Kaicutani  fixed-point  theorem  (5,9)  to  conclude 
0 o 

that  there  is  some  .x  • X,  with  x f F (x  ) ; that  is, 

p S p p p 

Lf  , . (X  ) - f(p,x  ) e I.f,,  , (X  ) + T(x  ) , 

Ti(x  ) p p r(x  ) p p 

P P 
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It 


0 e f(ppX  ) -f  T(x  > 

P P 

and  thus  i (p) , which  is  therefore  nonempty.  We  have 

graph  I ■ f(p»x)  f U x X.lo  « f(p,x)  + T(x) } ; 

0 

this  IS  closed  in  U * X by  joint  continuity  of  f and  closure  of  T.  However,  the 
6 

range  of  is  contained  in  the  compact  set  X ; thus  by  (9,  Lenwa  4.41  Z is  actually 

6 

upper  semicont mucus  from  U to  X*.  If  x.  e X then  by  (i)  one  has 

6 0 0 

0 ( Lf^  (Xg)  + ’’’<*0*  “ ^*Po'’'o*  * ’‘o  ^ ^ ^0' 

other  hand,  if  x t J(p_)  then  x r X and  0 t f(p. ,x)  + T(x) : therefore 
0 6 0 


so  that  X r F (x) . As  x r X,,  we  have  from  (2.4)  with  P • P„  that 
Pq  « 0 

dlx.Xgl  ; dlFp^(x)  ,Xq1  < X|lLf^(^,  (X)  - f(Po.x)||  . 

But  from  (2.3)  with  p » p^,  we  find  that 

||Lf^j^|(x)  - f(Po,x)l|<  B(6)||x  - s(x)l|-  6(4)dlx,X(j)  . 


Thus 


dlx.Xol  < X6(S)dlx,XQ)  < jdlx.X^l  , 


implying  that  x f since  is  closed.  Thus  we  actually  have  i (Pg)  • Xg. 


Now  ta)(e  any  c > 0;  find  4^  t (0,4)  such  that  for  o < 10,4^)  one  has 
AB(o)  < j e/O  + e)  ■ One  can  show  that  the  function 

>(p)  :«  max(  ||f2(p,x)  - f2(Pg,x)lllx  « Xg  ♦ 4^B}  is  well  defined  on  P and  is  continuous 
at  Pg;  choose  a neighborhood  U^(Pg)  c U so  that  if  p r we  have 

r (p)  c l(p^)  ♦ 4^B  and  )y(p)  < ~ r./(X  ♦ e)  . Now  choose  any  p t and  any  x « I (p)  • 
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I 

0 

Using  (2.4)  and  the  fact  that  x ' Fp(x),  w have 

d|x,r(Pg)  1 < d|Fp(x)  ,Xq1 

< X (X)  - f(p,x)|| 

< X ||h(x)  - h(x(x))  II  + X ||h(n(x))  II 

+ X ||f(p^,x)  - Lf^(^j{x)||  , (2.5) 

where  h(x)  :•  f(p,x)  - f(pQ,x).  If  we  define,  as  before,  x^  :»  Tx  + (1  - T)x(x),  we 
have 

||h(x)  - h(w(x))||  < ||x  - x(x)||  sup{  ||h‘(x^)||  |o  < T < 1)  . 

But  h'(x^)  ■ fjtp.x^)  - 

||h(x)  - h(x(x))||  < Y(p)||  X - ''(x)ll 

' Thus,  using  (2.2),  (2.5)  and  the  fact  that  ||h(ii(x))||  < a^ip)  , we  have 

^ d|x,i-(Pg))  < X y(p)||x-  ’'(x)ll  *■  Xag(p)  ♦ X6(S^)  ||x  - ii(x)|l 

< |t/(X  + c))  ||x  - *(x)||  ♦ XaQ(p)  . 

But  ||x  - x(x)||  - d|x,L(pQ)l,  so  if  X > 0 we  obtain 

|X/(X  ♦ €)  )d(x,r(Pjj)l  < XaQ(p) 

and  thus 

d|x,I(PQ)l  < (X  t t)ag(p)  . (2.6) 

r On  the  other  hand.  If  X • 0 tlion  (2.5)  implies  that  dIx,5;(Pg))  - 0,  in  which  case 

(2.6)  holds  trivially.  In  either  case,  therefore, 

Kp)  c I(p^)  ♦ (X  ♦ e)ajj(p)B  , 

which  roapletes  the  proof. 

Verification  cf  the  hypotheses  of  this  theorem  in  a particular  case  may  loe  difficult; 
this  is  particularly  true  of  (ii)  and  (ill).  It  is  therefore  desirable  to  loo)«  for 


I 
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classes  of  problems  for  which  this  verification  may  be  easier. 


In  the  next  section  we 


exhibit  such  a class  for  hypothesis  (ii);  we  do  so  for  (iii)  in  the  following  profwsi- 
tion. 

PROPOSITION  1:  In  Theorem  1,  the  hypothesis  (iii)  may  bo  replaced  by 
(iii)'  : is  positive  semidef inite ■ 

PROOF:  We  shall  show  that  (iii)',  together  with  the  other  hypotheses  of  Theorem  1, 

implies  (iii).  Choose  any  x.  r X„:  under  (iii)'  the  function  Lf  will  be  a maximal 

0 0 X 

0 

monotone  operator.  As  T is  also  maximal  monotone  and  as  dom  Lf  (the  effective 

X 

0 

domain  of  Lf  ) is  all  of  k”  , we  have  from  II  , Cor.  2.7]  that  Q(x^)  is  maximal 

-1  -1 

monotone:  hence  so  is  0(x  ) . The  set  Q(x  ) (0)  is  then  convex,  so  that  (i)  implies 

0 0 

that  Q(x  ) ^(0)  = X . It  follows  that  for  y e nB,  X n C)(x  ) ^(y)  c x +1  Hyll  B 
0 0 Y O O 

(by  (ii)).  Now  let  a e (0,n)  with  \a  < y . If  ye  uB,  the  convexity  of  p(x  ) ''(yl 

0 

implies  that  X^  n O(x^)  ^(y)  • Q(x^)  ^(y),  so  ^ is  locally  U.L.(A)  at  0. 

But  this,  together  with  the  boundedness  of  Q(x  ) ^ (0) , shows  that  Qtx  ) ^ is  locally 

0 0 

bounded  at  Oi  in  fact,  it  must  be  locally  bounded  at  every  point  of  int  uB,  since  the 

linage  of  some  ball  around  such  a point  will  loe  contained  in  the  image  of  iiB,  which  in 

turn  is  contained  in  the  bounded  sot  X,  « X„  + XoB.  But  then  from  (12,  Th.  1]  we  have 

Aa  0 

that  int  uB  cannot  contain  any  boundary  point  of  dom  Q(x  ) however,  as  int  uB 

0 

meets  dom  Q(x^)  (at  0)  and  is  connected  we  finally  conclude  that 
int  iB  c int  dom  Clx^^l  Thus,  for  each  y with  l|yl|  < a the  set  i® 

nonempty,  convex  and  contained  in  X^^^  c x^.  This  proves  Proposition  1 (replacing 
n by  any  fiositive  numlier  smaller  than  u)  . 

The  hypothesis  (iii)'  is  certainly  simpler  'nan  is  (iii):  however,  (iii)  covers  a 
more  general  class  of  problems.  For  example,  cresider  the  linear  generalized  equation 

0 t -ox  ♦ 6 ♦ (x)  , 


-12- 


I# 
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where  a > 0.  This  does  not  satisfy  (ill)':  however,  if  f: . ‘ * then  each  of  its  solu- 

* tions  (one  if  |6|  > n,  three  if  |p|  < i)  can  be  analyzed  under  (iii).  If  6i  » i then 
the  solution  at  - sqn  B can  be  so  analyzed,  but  the  solution  at  sqn  fi  cannot  (indeed, 

* the  conclusions  of  Theorem  1 fail  for  that  solution). 

3.  Polyhedral  multi  functions ■ In  the  last  section,  we  exhibited  a class  of  pro- 
blems for  which  hypothesis  (iii)  of  Theorem  1 always  held.  Here  we  do  somewhat  the 
same  thing  for  hypothesis  (ii);  we  show  that  for  a class  of  multi  functions  imfxirtant 
in  applications  to  optimization  and  equilibrium  problems,  local  upper  Lipschitz  con- 
tinuity holds  at  each  point  of  the  ranqe  space.  The  problem  of  verifyinq  hypothesis 
(ii),  in  the  case  of  such  functions,  then  reduces  to  that  of  showing  that  the  Lipschitz 
constants  are  uniformly  bounded  and  that  the  continuity  holds  on  a fixed  neighborhood 
for  each  function  in  the  family  considered.  For  the  application  given  in  Section  4 this 

* 

is  trivial;  some  cases  in  which  it  is  non-trivial  are  treated  in  Part  II. 

DEFINITION  2:  A multifunction  p : K™  is  polyhedral  if  its  graph  is  the 

union  of  a finite  (possibly  empty)  collection  of  polyhedral  convex  sets  (called  comixi- 
nents) . 

Here  we  use  “polyhedral  convex  set"  as  in  (13,  §19], 

It  is  clear  that  a polyhedral  multifunction  is  always  closed,  and  that  its  inverse 
IS  liliewise  polyhedral.  Further,  one  can  show  without  difficulty  that  the  class  of 
polyhedral  multifunctions  is  closed  under  scalar  multiplication,  (finite)  addition,  and 
(finite)  composition.  The  following  proposition  shows  that  they  have  good  properties 
also  with  respect  to  upper  Lipschitz  continuity.  For  brevity,  we  omit  the  proofs  of 
this  jroposition  and  the  next:  they  may  be  found  in  (101. 

PROPOSITION  2:  Let  F be  a polyhedral  multifunction  from  f"  into  s'".  Then 
there  exists  a constant  A such  that  F is  locally  U . L . ( X ) at  each  *q  ‘ R*'  . 

^ It  is  WTjrth  pointing  out  that  X depends  only  on  F and  not  on  x^,  although 

of  course  the  size  of  the  neighborhood  of  x^  within  which  the  continuity  holds  will 

I 
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in  general  dtgwnd  on  x 


The  imfortance  of  polyhedral  multi  functions  for  applications  is  illustrated  by 
the  following  fact,  in  the  statement  of  which  we  use  the  concepts  of  subdifferential 
and  of  a polyhedral  convex  function  (one  whose  eoiaranh  is  a polyhedral  convex  set), 
which  are  discussed  further  in  113). 


PROPOSITION  3;  l,et  f be  a polyhedral  convex  function  from  13  into  (-®,+=>). 
Then  the  subdifferential  is  a polyhedral  multifunction. 

It  follows  from  this  proposition  that  subdifferentials  of  polyhedral  convex 
functions  display  the  upper  Lipschitz  continuity  required  in  Theorem  1.  In  view  of  our 
earlier  remarks  about  polyhedral  multifunctions,  this  behavior  is  not  lost  if  we  combine 
these  subdifferentials  in  various  ways  with  other  po  yhedral  multifunctions.  For 

exeutiple,  let  C be  a nonempty  polyhedral  convex  set  in  f'’  and  let  (-*,+"1 

be  its  indicator  function,  defined  by 

f 0.  X t C 


+«>,  X ^ C 


It  is  readily  verified  that  is  a polyhedral  convex  function.  Now,  if  A is  a 

linear  transformation  from  k’’  into  itself  and  a e f"  , then  the  operator 
Ax  + a + 3iji^(x)  euid  its  inverse  are,  by  Propositions  2 and  3,  everywhere  locally  upper 
Lipschitzian.  Hence,  generalized  linear  equations  have  good  continuity  properties  with 
respect  to  perturbations  of  the  right-hand  side;  we  shall  exploit  this  fact  in  the  next 


This  discussion  also  shows  that,  if  the  operator  T in  Theorem  1 is  polyhedral, 

then  the  linearized  operators  Lf  + T have  at  least  some  of  the  continuity  properties 

*0 

required  in  hypothesis  (ii)  of  that  theorem;  it  is  still  necessary  to  prove  uniformity, 
but  this  is  trivial  if  is  a singleton,  while  in  general  it  can  often  be  done  by 

using  the  structure  of  the  problem  (e.g. , in  nonlinear  programming:  see  Part  II  of  this 


paper)  , 
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4.  An  ai’Pl icat  ion : stability  of  a linear  generalized  equation.  To  illustrate 
^ an  application  of  Theorem  1,  we  specialize  it  to  analyze  the  behavior  of  the  solution 

set  of  the  linear  generalized  equation 

» 0 t Ax  + a + 3n<^(x)  , (4.1) 

where  A is  an  n « n matrix,  a « , and  C is  a nonempty  polyhedral  convex  set 

in  . Such  problems  include,  as  special  cases,  the  problems  of  linear  and  quadratic 

proqrcunming  and  the  linear  complementarity  problem.  We  shall  characterize  stability  of 
the  solution  set  of  (4.1)  when  the  matrix  A is  positive  semidefinite  (but  not  necessari- 
ly symmetric) : a more  general  (but  more  complicated)  result  could  be  obtained  by  dropping 
the  assumption  of  positive  semidefiniteness  but  assuming  hyiiothesis  (iii)  of  Theorem  1. 

THEOREM  2:  Let  A be  a fxisitive  semidefinite  n » n matrix,  C be  a nonempty 
» polyhedral  convex  set  in  k”  and  a « b"  . Then  the  following  are  equivalent; 

a)  The  solution  set  of  (4.1)  is  nonempty  and  bounded. 

• b)  There  exists  > 0 such  that  for  each  n « n matrix  A'  and  each  a'  t B*' 

with 

c*  :=  max(  ||a'-a|1  , ||a’-a|l  ) < Eq  . (4.2) 

the  set 

S(A',a')  !»  {x|0  € A’x  + a'  + 3ii^(x)} 

is  nonempty. 

Further,  suppose  these  conditions  hold;  let  p be  a bound  on  S(A,a),  and  X t>e 
a local  upper  Llpschitz  constant  for  (A(,)  -tat  3i(i^(,)l  ^ at  0 (which  exists  by 
the  results  of  Section  3) . Then  for  any  open  bounded  set  t containing  S(A,a)  there 
is  some  > 0 such  that  for  each  A',  a'  with  max{||A'-A||  , |la'-a||)  < we 

have 

« » S(A’,a’)  n f c S(A,a)  + Xt ' ( 1- Xc ' ) *^ ( l+u) B . (4.3) 

» 

> 
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Finally,  if  (A', a')  are  restricted  to  values  for  which  S(A',a')  is  known 


to  be  connected  (in  particular,  if  A'  is  restricted  to  be  positive  semidef inite) , then 
y can  be  replaced  by  k"  . 

PRCXDF  (b  “ a)  ! If  (b)  holds  then  in  particular  S(A,a')  is  nonempty  for  all  a' 
in  some  ball  about  a.  This  means  that  0 belongs  to  the  interior  of  the  range  of  the 
operator  A(-)  + a + 3iJ,^(-),  which  is  mcUcimal  monotone  by  (1,  Cor.  2.7).  Accordingly, 
the  inverse  of  this  operator  is  locally  bounded  at  0 {1,  Prop.  2.9)  and  so  in  parti- 

cular S(A,a)  is  bounded. 

(a  b) : We  apply  Theorem  1,  taking  P to  be  the  normed  linear  space  of  pairs 


(A- ,a’) 

of  n X n 

matrices  and 

points 

of  , 

with  the 

distance 

f rom  ( A ' , a ' ) 

to 

(A", a") 

given 

by 

max{  j|  A'-A”  II 

, ||a'-a 

" II  } ; we 

take  Pq 

!-(A,a) , 

T:=3i(/^,  and 

f ((A- ,a' 

'),x)  A- 

X + a ' . The 

set  Xjj 

is  then 

S(A,a)  : 

we  let 

n be  any  open 

bounded 

set  containing 

>‘0 

» and  since 

Lf  (X) 

=‘0 

» Ax  + a 

for  any 

Xq,  it 

is  clear  that 

the 

0 

hypotheses  are  satisfied  {note  that  Proposition  1 implies  that  (iii)  holds).  We  then 
find  that  for  some  5 > 0,  > 0 and  all  (A', a')  with  c'  < e^,  we  have 

S(A',a')  n [S(A,a)  + 6B]  nonempty,  which  proves  (b) . 


Now  choose  f;  without  loss  of  generality  we  can  suppose  that  {)  was  taken  to  be 
this  f.  As  y is  bounded,  we  can  find  t (O.EqI  with  XEj^  < 1 and  such  that  for 
each  X € y,  E^(l+  ||x(|)  <n,  where  r\  is  the  parameter  appearing  in  Theorem  1.  Now 
pick  any  (A', a')  with  e'  < Ej^;  by  the  above  discussion  S(A',a')  n y is  nonempty, 
and  we  take  x'  to  be  any  point  of  that  intersection.  We  know  that 

0 £ A’x’  + a’  + 3i(.^(x')  , 

which  is  equivalent  to 

x*  £ 1A(.)  * a * 3y^(.))‘^((A-A’)x'  + (a-a*)]  . 

But  since  x'  £ t. 


I 


11(A-A')x'  + (a-a')ll  ■'  max(  ||a-A'||  , ||a-a'||  Ml  + l|x'l|  ) 


i * ilx'll  ) ; n , 

and  so  by  upper  Lipschitz  continuity, 

d(x',  S(A,a)l  < X||(A-A’)x'  + (a-a')|l 
Now  let  Xp  be  the  closest  point  to  x'  in  S(A,a);  then 

||(A-A’)x'  + (a-a')||  < 1|(A-A')Xq  + (a-a')|l  + ||  ( A-A' ) (x ' -x^lH 

< eMI  t u)  + E'  ||x'-Xp||  . 

Accordingly,  as  ||x'-Xq||  « dlx’,S(A,a)|  we  have 

d|x',S(A,a)l  < Xe'(1  + u)  + Xe 'd lx' ,S (A,a) 1 , 

yielding 

d|x',S(A,a)l  < Xe*(1  - XeM'^I  + u)  . 

Since  x’  was  arbitrary  in  S(A',a')  n f,  we  have  (4.3). 

Finally,  we  observe  that  for  all  small  e',  S(A',a')  n f is  contained  in 
S(A,a)  + which  is  contained  in  f.  If  S(A’,a')  also  met  the  complement  of  f 
then  It  would  be  disconnected;  thus  if  S(A',a')  is  connected  it  must  lie  entirely  in 
t,  so  that  we  may  replace  y by  in  (4.3).  In  particular,  if  A'  is  positive 

semidefinite  then  A'(*)  * a’  + is  maximal  monotone,  so  that  S(A',a')  is  con- 

vex as  the  inverse  image  of  0 under  this  operator.  This  completes  the  proof. 

One  might  wonder,  since  the  boundedness  of  f is  used  at  only  one  place  in  the 
proof,  whether  a refinement  of  the  technique  would  permit  replacement  of  f by  F*' 
in  all  cases.  The  following  example  shows  that  this  cannot  be  done  even  for  n ■ 1: 
take  C • F^  , A • (OJ  and  a • (1),  so  that  the  problem  is 

0 E |0)x  ♦ ID  + (X)  , 

whose  solution  set  is  S(  [01,(1])  « (0).  However,  it  is  readily  checked  that  for  any 


i 

j 
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t > 0,  S(l-tl,lll)  “ (0,  € M;  thus  wf  cannot  take  f » K in  this  case. 

Theorem  2 provides,  in  i>articular,  a complete  stability  theory  for  convex  quadra- 
tic programming  (including  linear  programming)  and  for  linear  complementarity  problems 
with  positive  semidefinite  matrices;  this  extends  earlier  work  of  Daniel  13)  on 
strictly  convex  quadratic  programming,  and  of  the  author  1111  on  linear  programming. 
Stability  results  for  more  general  nonlinear  programming  problems  are  developed  in 
Part  n of  this  pai>er. 

It  might  be  worth  pointing  out  that  the  strong  form  of  Theorem  2 (i.e.,  with  A' 
restricted  to  be  [Xjsitive  semidefinite)  can  sometimes  be  shown  to  hold  because  of  the 
form  of  the  problem.  For  example,  consider  the  quadratic  programming  problem 


minimize  ^<x,yx>  + <q,x>  + <p,y> 
subject  to  Bx  ♦ Dy  < d 


(4.4) 


(we  could  also  have  added  equality  constraints,  constrained  variediles,  etc.  but  have 
omitted  these  for  simplicity) . Here  Q is  m » m,  B is  r « m and  D is  r * s. 
The  formulation  of  (4.4)  as  a generalized  equation  is  (taking  0 to  be  symmetric) 


0 


- 

- 

o 

o 

w 

X 

q 

T 

0 0 D 

y 

+ 

p 

-B  -D  0 

u 

d 

. 

. 

+ 3i(/^(x,y,u) 


(4.5) 


where  C » . The  matrix  shown  in  (4.5)  is  then  the  matrix  A of 

Theorem  2;  it  is  positive  semidefinite  if  and  only  if  Q is  positive  semidefinite 
(i.e.,  if  and  only  if  the  problem  (4.4)  is  convex).  Now,  if  Q is  actually  positive 
definite  then  for  all  small  perturbations  of  the  data  of  (4.4)  (i.e.,  of  Q,q,p,B,D,  and 
d)  the  matrix  in  (4.5)  will  remain  positive  semidefinite  and  the  strong  form  of 
Theorem  2 will  hold.  The  point  here  is  that  the  structure  of  the  problem  prevents  the 
type  of  perturbation  which  could  destroy  the  positive  semidefiniteness  of  A.  This 
comnent,  of  course,  applies  in  particular  to  all  linear  programming  problems  111). 
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